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{IS VD) places boocock's (1967) Life Career Game in the core of its 
operating system. This paper considers the types of interaction that 
will l^e required of the syst^i, and discusses the role that a career 
decision game might play in its total context. The paper takes an 
into-thn-i : uture look at the day when an artificial intelligence 
system guiding simulated counselor, teacher, and career generator 
systems becomes a feasible programing task. Toward this ultimate 
goal, the author proposes to start v*th the career decision game, and 
to develop the full system as a series of increasingly complex 
aodif flattens of its basic format. The game in its present form is 
described and its use as a miniature model for the entire system of 
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Preface 



Ihe Information System for Vocational Decisions places the Life 
Career Game of Eoocock (196?) in the core of its operating system. The 
game has this location because it is a means which the inquirer has to 
engage in life planning in ways in which he can subject trial decisions 
to tests of their consequences in our existing societal arrangements both 
in terms of facts imputed to another ana in terms of facts Voiding for 
himsel f , 

There are two of writing within the 1SVD project about this 

gamelike possibility. One form of writing is about the game itself and 
abcut its implementation in the ISVD as the system takes its more final 
condition. The other form of waiting is about what the game idea can 
contribute to the understanding of decision processes of persons in edu- 
cation and of designers of th* ISVD itself. This paper by Roman is of 
the latter kind. 

Ihis paper was originally is3ued as a working paper in February 
1967. now reissuG it js a Project Report because its ide^s have not 
yet been superceded ard because those ideas deserve attention from the 
wider audience within reach of our Project Report distribution. 

David V. Tiedeman 



31 October 1969 
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IMPLEMENTATION OF A CAREER DECISION GAME ON A TIME SHARED COMPUTER: 
AN EXPLORATION OF ITS VALUE IN A SIMULATED GUIDANCE ENVIRONMENT 



Richard Allan Roman 
Graduate School of Education 
Harvard University 



The general goals of the ISVD project are stated in its proposal 
the granting agency rnd in other literature (Annual Reports* ISVL, 1V66- 
1S69). The purport of this paper is to consider the types of interaction 
that will be required of the system* and to discuss the role that a career 
decision game might play in its total context. 

Hie users cf the system will include many who viil find that the styl- 
ized rigidity of ordinary computer programming interferes with their purposes. 
These people must express their thoughts in an Englieh-liVn language, and 
should not be burdened with unnecessary details of programing. A polite 
diagnostic system should instruct then, when they err. Others, in the 
Interest of eff iciency, will want more direct commvnicat ion with the pro- 
grammed systems, and they too should be s* ti n led. 

ISVD users can be divided roughly into the following categories: 
programmers, educational researchers* trained counselors* student coun- 
selors* inquirers in the schools and opoortunity centers, and clerical 
workers. These categories arc neither mutually exclusive nor exhaustive; 
they merely represent anticipated users of the system. 

What facilities will be demanded by these users? This cannot be 
answered without a full understanding of thu highly abstracted functional 
units of the system and their interactions (See Figure )). The final 
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prototvpe of the ISVD project will be characterized by a programmed 
supervisor interfacing between the users and the internal routines, a 
d<k tc?i bank and supporting routines, and an artificial intelligence system 
controlling the operations of the simulated teacher, simulated counselor 
and simulated career generator. All of the routines will draw on the 
data bc v nk extensively, and will be controlled by the artificial intelli- 
gence. The supervisor will determine which user is to be serviced next, 
and assign space within the computer. 

One of the goals of the ISVD project is a clearer understanding of 
the guidance process. One of the most successful methods for forcing 
clarity in thought ic simulation. In simulation, the important processes 
to be modeled are abstracted and written in the form of a computer program. 
This program works or fails, and thereby indicates the strengths and weak- 
nesses of the model. 

We in the ISVD project are interested not only in imitating what the 
counselor does <lo, but in doing vhat the counselor would like to do. The 
computer can handle larger amounts of information than a human being. 
Therefore, if we specify the information transformations carefully, the 
computer can surpass human performance in this regard. This is one aspect 
of vhat is called artiflclcl intelligence. 

Artificial intelligence in this paper will be a general method for 
measuring performance an^, improving on it. The specific task is irrelevant 
to artifical iritelllger.cn , Unco it applies hif a order hruristic rules -- 
such as goal seeking ar J subgoal formation and working backwards from goal 
to present state — to a variety of tasks. Thus* one artificial intelli- 
gence routine can be applied to a simulated teacher, a simulated guidance 
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In short, the artificial intelligence system is a routine that 
includes the: tools for learning to improve performance. These tools will 
be applied to each of the simulation routines developed for the project. 
Simulation and artificial intelligence thus go hand in hand for the pur- 
po s of the ISVD project. In the simulation stage, the present methods 
of decision-making are specified; in the artificial intelligence stage, 
the methods for improving decision-making ar<» explored. 

The artificial intelligence system functions by guiding the 
subordinate simulation routineo. For example, it could tell the simulated 
teacher that more importance should be given to how long the student takes 
to answer and less to his IQ score. 

Consider the simulated teacher in more detail. The simulated 
teacher will have a variety of methods for presenting concepts. These 
will include various media of presentation, different vocabulary levels, 
and different logical sequences. It will also have available the student 
profile containing data on socio ’economic status, test resulta, school 
records, and personality measures. Finally, it will have records of pre- 
vious lessons that will include errors made, latency of response, and 
character of the material. 

Many of these factors will be taken in account as the teacher 
decides what material to present next. Some factors are clearly more 
important than others in the decision. This will be taken in account 
by weighting each factor differently. The teacher will uee the assigned 
weighting of factors until some estimate of its efficiency is made by the 
artificial intelligence* 
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The artificial intelligence system will have access to a vast 
variety of individual records, and can look at the whole picture in a 
way the teacher is too restricted by its position to manage. With this 
broader perspective, the artificial intelligence system can determine 
a better way of* weighting factors. It will then give the new set of 
weights to the teacher who will proceed with them as it did before. 

The critical and difficult question this procedure leaves is 
to define precisely what is meant by better teaching. The system will 
approach whatever goal is set. Setting the right goal to the project’s 
responsibility . 

The other two simulated systems are more specialized than the 
teacher. The simulated counselor will look st the student profile and 
creace suggestions and recommendations for the student. It might sug- 
gest a specific test to gain further information, or 11a*. relevant 
occupations for the student, or compute frequency tables for success in 
particular Jobs . 

The final simulated system is the career generator. This would 
be a probst ill at ic model that would predict the course that a person's 
life would take, given a past profile. This past profile could be the 
up-to-the-moment history, o*- the history supplemented with a decision 
to pursue some sctlon In the future. It could be asked questions like: 
What will happen to John if he decides to major in Far Eastern studies? 
What will happen to Hr. Smith if he goes to night school and finishes 
his high school work? The answers would be probability statements, or 
best guesses at tha actual results. This routine could have a recursive 



feature, which would allov it to pursue a person’s career through 
several discontinuities before returning an answer. 

The key to the effectiveness of all of these simulated systems 
is the usefulness of the data bank. The stored data and the easy ac- 
cess to material in the bank would allow all of the simulated systems 
to be pre-tested on the records of the individuals. In this way, the 
initial settings of the parameters cou?d be determined without risk to 
those using the system. No advice need be followed; no career plan 

fulfilled. The machine can make many errors as it develops an estimate 

of the best plan for action while interacting only with data. Once the 

estimates became stable and reliable* researchers could determine their 

relevance and realism by further testing from the data bank. If the 
machine’s estimates seemed dangerously far off, the researchers could 
adjust parameters to obtain results they thought were more realistic. 
After further calculations utilizing the adjusted parameters, another 
feedback session would be in order. In this way, the program could avoid 
loral maxima in the multi-dicnensionai spaces in which they will work. 
Periodic checks by skilled members of the simulated professions would 
guide the computer on its search. 

The three simulated programs would interact with one another, 
each supplying its lest estimate of the effects of the other's actions. 
The simulated counselor, for instance, would look at the profile data of 
an individual facing a discontinuity. After considering the relevant 
information, It would make a decision, and submit It to the career 
generator, which would then simulate several years In the individual's 
life. The resulting projected profile could then be scored by the values 
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included in the profile, Next* any discrepancy between the ideal and the 
actual projection could be minimized by testing alternate decisions of 
the career generator. When the minimum discrepancy is encountered, the 
artificial intelligence system could suggest new weightings for the 
guidance counselor to use. 

Similarly, the program designed for teaching might b<; avp'ied to 
teaching dec Islon-naklng skills. It could call on the simulated guidance 
counselor to aid in its estimation of che student's skill. 

“ All of the above is idealized, and far from a feasible programming 
task in the immediate future. There are available some approximat ions to 
the kind of programming required, but the scope of this problem is far 
beyond the capabilities of any existing program, Wc must consider ways in 
which we can move toward this ultimate goal. The system mu9t be useful 
before it reaches the level o* sophistics tion for which ve are striving. 
There are approximations, which can be implemented simply and quickly, 
that would serve is a basis for expanding the system to full power. 

One possible plan Is to start with «i career decison game, and to 
develop the full system ar a serier of increasingly complex modifications 
of its basic format* Such a game wculd reduce the level cf abstraction 
required for the initial development of the syctera without changing the 
fundamental questions ISVD must answer. 1 not suggesting that the gasne 
1 8 in any way necessary to the project* It would be dispenstble at any 
stage of the project, end serves here only as a focal point for the 
developing system. 

The starting point for my thinking was the preliminary version of 
a career decision game devised by Eugene Wilson* Since literature about 
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this gam 1 is not yet available, I include a summary here.* 

The game consists of a series of discontinuities to be solved by 
the player. A die continuity is a choice point in ?. person's life. Vor 
example, choosing a pattern of courses in high school, deciding on a 
type of college, or picking a major are discontinuities. A Ji scont inui ty 
is solved wnen a firm decision on a course of action has been nade. 

The player is presented with a d iscont inui ty and a personal pro- 
file sketch, wnich includes the name, age, and sex of the person facin 
the discontinuity. The player assumes the role of the pers n ir the 
profile, and tries to gather further information from the complete profile 
to help him clarify factors bearing or. the decision. The additional infor- 
mation is presented from the prof 11: in the order set by Mr. Wilson* the 
player cannot influence the order in which he receive* the information. 

After each piece of information is requested and digested, the 
playei examine- the list of alternative solutions to the discontinuity, 
and tries to narrow the range of appropriate choices for his profile. 

Tha game continues until no additional information is available in the 
complete profile, or until a player reaches a final decision. The player 
tries t make the decision most appropriate for the person In the profile. 
Evert after all the information In the profile available, the grounds 
for decision may not be clear, so he player may have to make his final 
commitment on value Judgments. 

The preliminary version of the game has a paper and pencil format. 

One persoi presents ths discont inuit tes and information to a second person 

1. This information came fro® my convataat'or.9 with Mr. Wilson on Octobci 
10, 1966 and earlier dates. The game is still being rc\ised, so this report 
Is of my understanding at that time. The revisions and modifications sug- 
gested in this paper are solely my i esponsibillty . 
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vho plays the game. The *nf ovroa t ion about these factors is presented in 
a fixed arbitrary order. The player does not ask for specific information, 
but must accept the next piece that comes up regardless of its usefulness. 

Players who don't know what a particular test score me .ns have no 
way to help themselves. Tnere is no provision within the game to allow 
the player to use books or table3. The game contains no specific teaching 
of declsl n-making skills. The game will be part of a total program for 
increasing decision-making skills, in which the student will have instruc- 
tion before and after the game is played. 

There is little .ed for a computer to handle the present game 
structure. A regular teaching machine would be quite adequate. However, 
the many contemplated improvements will introduce complications that will 
require a computer to handle the data and decision-making functions. 

Before the game can be computerized, Its structure must be well 
understood. Figure 2 provides a summary of the game in flow chart form. 

There are several important lists in the game: discontinue t ies (a list of 

descriptions of possible discontinuities), possibilities ( set of possible 
solutions corresponding to each dis< ont inui ty) , profiles (a list of inior- 
mation aWui people -- several for each discontinuity), and judgments (a lift 
of the relationships between the information In the profiles and the possible 
solutions to the discontinuity). As examples of the list of judgments, a 
male could not go to a girls' college, a student with an IQ below 120 
could not be in hvrots courses, a man with a mechanical aptitude below 
the tenth percentile should not brr an auto mechanic. 

The game In its present f or ra Is completely determined once the 
discontinuity md profile are chosen. The information presented does 
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not depend on the ability of the player, arid the feedback la a fixed 
function of the player's choices. Tor each discontinuity and profile, 
the scrip: specifies exactly what information Is needed to eliminate an 
alternative. The script witer ;nust examine every possible response 
and provide appropriate feedback, He must arbitrarily decide which is 
the correct choice rather than rely on statistical analysis of similar 
cases, This is a lengthy and thankless task, one which should not be 
undertaken for more thar* a few discontinuity-profile pairs, The infor- 
mation gained by such brute force programming wKl help us understand 
the process of analysis, so that we can simulate it later. Results of 
running the finished scripts will provide some feedback on the properties 
of the game. 

We need to devise a list processing language flexible enough to 
handle the presentation of material, the complex conditionals needed, and 
the record keeping required. MINGPCA I will easily handle this version 
of the game. Later modifications of the language will allow it to handle 
all of the extensions of the game discussed below. 

In this discussion bslov, the game is the starting point for de- 
velopment of the entire system of interacting simulations with which this 
paper opened. The game will become a miniature model of the entire system. 

The game, as described above, will be the early prototype of the 
simulated teacher. Eventually, the same system will provide all interaction 
with the users. Extentions of the game will more closely approximate the 
1SVD vision. Part of the working philosophy of the 1SVD project is to 
provide the student with the opportunity to learn about decision-making, 
to increase his ability to turn data Into information, to help him see 
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how information can be used to solve complex contingencies, and to provide 
feedback about his performance. In order to facilitiate this improvement 
in skills* the game could be enlarged to allow the student to enter an 
“inquiry mode". In that mode, he would seek specific information about 
the profile on which h§ was working, rather than passively accept the 
script writer’s order of presentation. This would force him to engage more 
actively in the process of information gathering and wou* d therefore cause 
more profound changes <n his behavior. If the player found that he could 
no longer intelligently seek further information or use the data he had 
gained from earlier inquiries, he could return to the "presentation mode" 
and allow the script writer to prompt him. 

Another desirable modification of the game would allow the student 
to interrogate the information and teaching files. These files would pro- 
vide paragraphs about the alternatives from which the student might choose, 
and information about the test scores included in the profiles. With this 
provision, the student might ask, for Instance, “What is an IQ score?" or 
"WTiat does an undertaker do?" 

Making this feature available has implications beyond the game. 

The same programming would alio* counselors to ask for Job descriptions or 
summaries of college admissions requirements. Researchers could use this 
feature to ask for statistical ccrrelations and frequency tables constructed 
by examining the data bank, Information about people with similar pro- 
files would be available from the data bank. This information would be 
useful to the script writer while he wro.e, and would give him firmer 
groundt for his decisions in particular situations. The player should 
have limited access to tie bank. He should be able to ascertain what. 
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happened to others with similar profiler when they accepted each of the 
various alternatives available to hin. 

At this point, the process we are d?;pcrib 1 ng ceases to be a game. 
The inquiry mode a^u the statistical routines are appropriate tools for 
the student personally facing a discontinuity* Similarly, the counselor 
can use the routines to find information relevant in guiding a student* 

Another function of the game is to provide feedback to the student, 
and evaluate hra performance. This evaluation should become part of the 
player’s record in the data bank. His performance on future triale 
could be compared with those of the past 1.0 estimate his growth. In 
this way, the game becomes part of the monitoring function and provides 
useful information about the student* 

To "estimate growth, M the goals of the game will have to be more 
clearly stated. Superficially, the game shojlo increase the student's 
readiness for career decision planning and progress should be measured 
on the O'Hara scale devised for that purpose* To be a useful measure, 
the test would have to be given several times* The details of adminis- 
tration and the practice effect on the scale would have to be determined 
so that scorts could be meaningfully compared* The game itself might 
serve as a test, if performance could be reliably correlated with come 
external measure, it certainly offers an attractive alternative to the 
dull paper and pencil lasts usiti today. 

As we gain greater understanding of the game by watching students 
play, a classification of easy and difficult discontinuities will appear* 
At that time, random assignment of discontin^it lea for solution will 
become wasteful. With a more rational basis for assigning problems 
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cor 'esponding Co Che student's abilities, the game becomes a controlled 
learning experience for the player. Rounds of the game could be Inter- 
spersed with lessons or sessions in the inquiry mode. We could increase 
the student's level of competence by making each lesson depend on those 
preceding it. After the appropriate lesson, the student could demonstrate 
his mastery of the new skills introduced in the leBSon by successfully 
completing a round of the gArne. 

When we view the game as an extension of the simulated teacher, 
it becomes clear that L.'any factors influence the optimal order for lessons. 
Ve uust ask what we mean by the concepts we use freely in conversation. 

How do you tell that a peroon has mastered the implications of the IQ 
scores? How do you know he has transferred his knowledge from ;he game 
to practical situations? How do you know he is improving? How do you 
measure teaching effectiveness? 

These are the queations that arise about the game. In that context, 
they have concrete form. You can measure score on the game, length of time 
to make a response, and readineea for planning. You can look at th.i order 
in which the student seeks Information, and check to be sure he has elim- 
inated all Improbable alternatives. 

Dealing with the questions in this concrete form will help us 
discover where to look for the answers to the same questions about tha en- 
tire system. The closed universe of the game gives us a finite level 
of discourse that makes concrete the abstractions vith which ISVD must 
deal < 

After watching many students play the game, we will be able to 
discover heuristic arguments they use. Our own play with the fame, both 
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as ecript writers and as imitation players will give us insight about 
reasonable assumptions to make. These assuraptiors and heuristics could 
be built into a simulated game player. The machine could then play the 
game by our rules and show us how acute and comple:e. our observations 
were. This would provide further stimulation for observation. This 
simulated game player is rhe beginning of the simulated counselor. All 
we would need to do is to give it real discontinuities and real profiles, 
and it would arrive at a reasonable course of action for that individual. 

In this sinulated player, ve have relief from the tedious labor of 
creating scripts for profile discontinuity pairs. The machine can reach 
optimal solutions aj easily as script writers. It needs to have approp- 
riate general material for feedback, and then it can supply particulars 
for any discontinuity profile pair. We also have eliminated the problem 
of creating Ideal profiles. The simulated counselor can examine large 
numbers of real profiles from the data bank and select those that make an 
interesting game. 

Similarly, the career generator could begin as a game player. Given 
an existing profile and discontinuity, it would generate a solution. It 
would then use the frequency tables to find thj probable outcome of the 
decision. The outcome would be appended to the existing profile, a new 
discontinuity chosen, and another cycle played. In thie way an entire 
career could be generated as a scries cf plays in the game. 

These programs rely on each other. The simulatod teacher draws on 
tha simulated career generator for materials. The career generator uses 
che simulated pla/er to solve single discontinuities , and integrates a 
series of discontinuities Into a career. The student playing the game 
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supplies an answer which can be evaluated with the career generator. 

The simulated counselor will provide optimal solutions and feedback 
reasons for rejecting certain possibilities. 

In order for the system to improve its performance, a master 
artificial intelligence must guide the performance. It will integrate 
all results and change the way in which internal decisions are made in 
order to bring the system closer to its goals. 

Thus, the entire project c*n be viewed as a series of modifications 
of the basic game format. In each stage, the program can supply additional 
information about the decision-making environment and the users of the 
system. 

The game becomes a model of the whole system. Concentrating out 
attention on the game is a way of thinking about the entire project. The 
questions the game brings to mind are but smaller versions of the questions 
raised by the system as a whole. Similarly, the entire project can be 
viewed as an extension of the game. Problems solved for the game will 
give the cluej to the answers for the entire system. 




IB 



References 



Boocock, Sarane. (1967) "The Life Career Game 1 * In: Personnel and 

Guidance Journal . 46, 328-334. 

Information System for Vocational Decisions. (1967) Annual Report: 

1966- 1967 . Carol ridge, Massachusetts: Harvard Graduate School of 

Education . 

Information System for Vocational Decisions. (1968) An nual Report: 

1967 - 1968 . Cambridge, Massachusetts: Harvard Graduate School of 

Education. 



